Mobile communication terminal and mehtod therefore

ABSTRACT

The disclosed embodiments relate to a mobile communication terminal including a user interface and a processor. The mobile communication terminal receives real time acquired colour data, from which the processor generates a colour scheme for the user interface. The light generating means receive the colour scheme and provide a coloured light to user interface in accordance with the colour scheme.

FIELD

The disclosed embodiments relate to a mobile communication terminal,such as a mobile or cellular telephone, or rather relates to control ofappearance and colour of the mobile communication terminal.

BACKGROUND

In personal computers operating under Windows® or Apple® operatingsystems the user may change the wallpaper of the display into anydesired colour or pattern and may in fact use a photograph as awallpaper. Further, recent mobile telephones have been equipped withcameras so that a photograph taken by the mobile telephone may be useddirectly on the mobile telephone as a wallpaper.

Both in personal computers and in recent mobile telephones the wallpapermay be easily changed or altered. However, the colour scheme or patternof the overall appearance of the mobile telephone is difficult to change(a differently coloured second physical cover may be required), which istime consuming and expensive.

International patent publication WO 2006/02491 discloses a communicationterminal capable of receiving colour data from a photograph andgenerating a colour scheme for a user interface of said communicationterminal based on the colour data. Light generating means are thenadapted to receive said colour scheme and to provide a coloured light tothe user interface in accordance with said colour scheme. However usefulthe solution according to international patent publication WO 2006/02491is, it is still experienced a need for further developing convenient andattractive ways of altering the appearance of communication terminals.

SUMMARY

It would be advantageous to provide a mobile communication terminalhaving an overall appearance which easily is changed in accordance withany colour or pattern schemes.

A particular advantage of the disclosed embodiments is the provision ofan appearance, which may be controlled by the mobile communicationterminal in accordance with user preferences.

A further advantage of the disclosed embodiments is the provision of away to easily make own personalized user interface graphics.

A particular feature of the disclosed embodiment relates to theutilization of a viewfinder, such as that of a camera, for enabling auser of the mobile communication terminal to search and capture visualinformation to generate a desired colour or pattern scheme. Inparticular, the disclosed embodiments relate to the utilization of aviewfinder presenting an image as detected by image acquiring componentsthrough the lens of a camera integrated with a cellular phone.

The above advantages and feature together with numerous other advantagesand features, which will become evident from below detailed description,are obtained according to a first aspect of the disclosed embodiments bymobile communication terminal comprising a user interface, imageacquirer and a processor, wherein said mobile communication terminal isadapted to receive real time acquired real time acquired colour datafrom said image acquirer, said processor is adapted to generate a colourscheme for said user interface based on said real time acquired colourdata, and wherein light generating means are adapted to receive saidcolour scheme and to provide a coloured light to said user interface inaccordance with said colour scheme.

In this context the term “mobile communication terminal” is to beconstrued as a mobile or cellular telephone, a personal digitalassistant, or a laptop computer. The term “colour scheme” is in thiscontext to be construed as a colour theme or colour shade plan, whichmay be digitally stored and generated.

Further in this context the term “user interface” may be construed as adisplay and image(s) that provides the user with control information andare displayed on the display, and as the display together with a cover,a light guide, and a keypad.

An advantage of the mobile communication terminal according to the firstaspect of the disclosed embodiments is that the light generating meansenable the operator of the terminal to control the colours of each ofthe elements of the mobile communication terminal. Hence thepresentation or appearance of the mobile communication terminal may bematched to for example the operator's outfit or clothes.

The user of the mobile communication terminal may generate a photographof the user's shirt, which photograph is then processed to generate acolour scheme for the terminal. The colour scheme may be generated tomatch the user's shirt. The colour scheme may comprise a colour patternor a photograph, that is, the display of the terminal may present thephotograph while the other elements of the terminal present coloursmatching the photograph.

A further advantage of the disclosed embodiments according to the firstaspect is that the appearance of the mobile communication terminal maybe changed continuously depending on what the image acquirer receives asinput. The user interface is thus updated instantly, and there is noneed for the user to take the long way round via for instance a storedimage or snapshot.

Possible elements that might use this are for example selection frames,scroll bars, input elements, frames, dialog or some other arebackgrounds, icons and any other UI elements. This can be used also as avisualization effect without any UI element, for example showing somereflections in the corners of frames or as a background of a title bar.

Hence, with the disclosed embodiments, it is enabled a real time viewfinder assisted reflection of a user interface appearance of acommunication terminal.

In addition, the real time image acquiring feature may be left on,enabling continuously adaptive user interface in respect of thesurrounding environment, like a chameleon.

In addition, according to the disclosed embodiments, it is also possibleto use video or still image material. Visualizations can be rendered asanimations or video sequences. For instance, motional material may bepresented repeatedly or looped when visualized onto the surface of theuser interface elements and material received from a plurality of stillimages may be animated and played back in a similar fashion.

The processor may further comprise or be in communication with agraphics accelerator. As an advantage, it enables rapid updating orrefreshing of visualized data. The image acquirer may also be directlyconnected, or integrated with, a graphics processor, such as to enableeven further advantages of rapid updating or refreshing of visualizeddata. Advantageously, the graphics accelerator is capable of renderingthree dimensional (3D) graphics.

The light generating means according to the first aspect of thedisclosed embodiments may comprise a light source having one or moremulticoloured light diodes. In fact, the light source may have aplurality of sections of multicoloured light diodes adapted to becontrolled by the processor. Alternatively or additionally, the lightsource may comprise a liquid crystal element or a series of liquidcrystal elements adapted to be controlled by the processor.

The processor according to the first aspect of the disclosed embodimentmay further be adapted to perform:

-   -   (a) receiving real time acquired colour data from a real time        acquired colour data generator;    -   (b) indexing of colours of pixels of said real time acquired        colour data and generating an array of indexed colours;    -   (c) selecting a grouping parameter;    -   (d) grouping of said indexed colours in accordance with said        grouping parameter; and    -   (e) allocating grouped colours to said user interface, keypad        and cover of said mobile communication terminal.

By indexing the colours of the pixels of the photograph the processorsmay identify all colours of the photograph, and by grouping the indexedcolours the processor may determine, which colours should be used foreach element of the terminal, i.e. the display, keypad, or cover. Thisis particularly advantageous, since the display may present a photographas a wallpaper, and the operational menus on the display are overlayingthe wallpaper with colours in accordance with the colour grouping.

According to a further embodiment, the user interface may comprise userinterface elements each having a surface onto which texture informationcan be mapped based on information from said colour scheme.

As an advantage, visual information captured by the real time imageacquirer can be mapped onto the surfaces of the user interface (UI)elements in any possible way. Hence, visual information can be mapped asa texture to the UI elements surface according to any texture mappingmethod or for example be reflected to and/or from a reflective surfaceof the UI elements. Concurrent with the mapping of visual information tothe user interfaces presented in a current view of the display, theremaining part of the display may continuously act as a view finder bypresenting an image of the object in front of the camera. The viewfinder image may be presented in the background, with the user interfaceelements in the foreground, or as a miniature image in a certainlocation of the display, such as in any corner of the display or simplyin a location where it does not interfere with any objects such as openwindows, dialogue boxes, menu items or status indicators.

The mapping may involve rendering of vector graphics. As one advantage,efficient mapping of a reflection or a texture to the surface of a twoor three dimensional user interface element.

The concurrent presentation of a view finder image and mapping of visualinformation onto user interface objects may be materialized in variousways, of which two examples will be given in the following. Forinstance, the view finder image may constitute a first layer on top ofwhich a second layer comprising the image mapped interface elements.Alternatively, the mapped user interface elements are inserted into thesame layer as the view finder image, and thus replacing the visualinformation of the view finder image in those areas which are replacedwith the user interface elements.

The texture of the UI elements may be colourless or exhibit a glasslike, transparent appearance. The UI elements may further appear asthree dimensional (3D) objects. Especially, the UI elements can renderany kind of objects that can be mapped with texture. The surface of theUI elements onto which the texture can be projected may even appearsmoke-like. The wording texture is in this context to be construed tocomprise any visualization that can be mapped to the surface of anobject, especially that of a UI element, and in particular in connectionwith presentation on a display of communication terminal.

In this regard, as well as in other aspects of the disclosedembodiments, it may be advantageous to have more than one imageacquirer. For instance in the case where one is used to acquire imageinformation, which is mapped to the UI elements, and another is used toacquire image information for the background image.

According to still yet a further embodiment, the mapping may beconfigurable such as to reflect a customized appearance of said texture.

As an advantage, sophisticated user actions may be added, enabling auser for instance to choose exactly how the mapping is to be implementedto reflect certain characteristics of the texture of the user interfaceelements. For instance, a user is enabled to select where or how to mapthat to the elements, or even to specify rotation of the texture aroundan element. Alternatively, the process is administered automatically,such that the only input needed from the user is to find the right viewin the view finder, while at the same time seeing how the UI looks.

The above advantages and features together with numerous otheradvantages and features, which will become evident from below detaileddescription, are obtained according to a second aspect of the disclosedembodiments by a method for generating a colour scheme for a mobilecommunication device comprising:

-   -   (a) receiving real time acquired colour data from a real time        acquired colour data generator;    -   (b) indexing of colours of pixels of said real time acquired        colour data and generating an array of indexed colours;    -   (c) selecting a grouping parameter;    -   (d) grouping of said indexed colours in accordance with said        grouping parameter; and    -   (e) allocating grouped colours to a user interface, keypad and        cover of said mobile communication terminal.

The real time acquired colour data according to the second aspect may aphotograph, a drawing, or any combination thereof. The real timeacquired colour data may be taken directly as a snapshot by the cameraof the mobile communication terminal or be downloaded from acommunication network. Alternatively, the real time acquired colour datamay be a piece of art generated or downloaded to the mobilecommunication terminal by the user.

The grouping parameter according to the second aspect of the disclosedembodiments may comprise one or more elements establishing designcriterion for the colour scheme. The grouping parameter may be selectedby the user of the mobile communication terminal or may be a defaultvalue stored in the mobile communication terminal, or in fact, acombination thereof.

The colour scheme according to the second aspect of the disclosedembodiments may comprise an overall plan for combining of colours andpatterns that are to be applied to the display, keypad and cover of themobile communication terminal. The colour scheme advantageouslyestablishes a set of rules to be followed during the establishing adesired appearance of the mobile communication terminal.

The method according to the second aspect of the disclosed embodimentsmay further comprise checking colour scheme output and feed back of anadjusted grouping parameter. The method thereby advantageously allowsthe mobile communication terminal for continuously make sure that thecolour scheme utilized provides a visible user interface.

The above objects, advantages and features together with numerous otherobjects, advantages and features, which will become evident from belowdetailed description, are obtained according to a third aspect of thedisclosed embodiments by a computer program product such as acomputer-readable medium having computer-executable componentscomprising instructions for receiving real time acquired colour datafrom a real time acquiring colour data generator;

-   -   (a) indexing of colours of pixels of said real time acquired        colour data and generating an array of indexed colours;    -   (b) selecting a grouping parameter;    -   (c) grouping of said indexed colours in accordance with said        grouping parameter; and        allocating grouped colours to a user interface of said mobile        communication terminal.

The computer program product may further be adapted to perform any ofthe previously disclosed methods when run on a mobile communicationterminal according to any of the previously disclosed embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS

The above, as well as additional features and advantages of thedisclosed embodiments, will be better understood through the followingillustrative and non-limiting detailed description of preferredembodiments with reference to the appended drawings, wherein:

FIG. 1, shows a mobile communication terminal according to a firstembodiment,

FIG. 2, shows a block diagram of the mobile communication terminalaccording to a first embodiment,

FIG. 3, shows a flow chart of a process utilised by the mobilecommunication terminal according to the first embodiment.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

In the following description of the various embodiments, reference ismade to the accompanying drawings, which show by way of illustrationvarious embodiments, in which the invention may be practiced. It is tobe understood that other embodiments may be utilized, and structural andfunctional modifications may be made without departing from the scope ofthe disclosed embodiments.

FIG. 1 shows a mobile communication terminal designated in entirety byreference numeral 100. The mobile communication terminal 100 comprises adisplay 102 and a keypad 104 enabling the user of the mobilecommunication terminal 100 to interface with the mobile communicationterminal 100. The mobile communication terminal 100 further comprises acamera 106 for taking of photographs, which may be presented on thedisplay 102 in accordance with the user's instructions. The camera 106is shown in FIG. 1 positioned on the front side of the mobilecommunication terminal 100 entirely for simplicity reasons, the camera106 may appropriately be positioned on any surface of the mobilecommunication terminal 100. In particular, the camera 106 mayadvantageously be positioned on the rear surface of the mobilecommunication terminal 100, so that the user may concurrently see in thedisplay 102 what is targeted in the camera view.

The mobile communication terminal 100 further internally comprises acolour controlling device 108, which enables the user to control thecolour and thereby appearance of the mobile communication terminal 100.For example, the user may take a photograph and apply this photograph asa wallpaper on the display 102 and further instruct the colourcontrolling device 108 to generate a colour scheme, which is implementedin the display 102, in the keypad 104 and in selected cover parts 110,such as for example the edge 112 of the cover 114.

FIG. 2 shows a block diagram of the mobile communication terminal 100described above. Further, FIG. 2 shows in detail the colour controllingdevice 108 communicating with the display 102, the keypad 104, and thecover 114.

The colour controlling device 108 receives real time acquired colourdata 116, for example a photograph or video stream received from thecamera 106 or downloaded from a communication network. The user of themobile communication terminal 100 may use the camera 106 for panningover an area thereby generating a video sequence on the display 102 andat any point press a key on the keypad 104 so as to freeze the cameraview as a photograph. This photograph may then be used for generating acolour scheme for the mobile communication terminal 100.

The colour controlling device 108 comprises a processor 118, such as amicroprocessor or a micro-controller, which is adapted to receive theacquired colour data 116. The processor 118 indexes the real timeacquired colour data 116 in an array of colours, which are detected inthe real time acquired colour data 116. For example, if the real timeacquired colour data is a photograph having 256 colours an index arrayof 16 by 16 is generated. Obviously, the photograph and the real timeacquired colour data 116 as such may have any number of colours, such asin the range between 3 to 1024.

The term “colour” should in this context include any scale of grey. Thatis, the real time acquired colour data 116 may be a grey scaledphotograph.

The processor 118 groups the colours of the index array in accordancewith a selected design criterion. The processor 118 uses the groupedcolours for generating a colour scheme to be loaded in to table 120. Thetable 120 may be implemented as any ordinary random access memory. Thecolour scheme describes allowable combinations of colours, i.e. whichcolours may be used in combination with the real time acquired colourdata 116. For example, the photograph may show a steel grey building,and therefore one design criterion may be to allow colours in the greyscale to be used for menus overwriting the photograph when used aswallpaper on the display 102. Obviously, the design criterion mayinclude physiological parameters, which define the most visible colourcombinations.

The processor 118 forwards a control signal to a device driver 122 forcontrolling colours of the display 102 and a light source 124. Thedisplay 102 and the light source 124 are driven by the device driver 122in accordance with the colour scheme generated by the processor 118.

The light source 124 may comprise one or more multicoloured lightemitting diodes (LED) and/or liquid crystal panels. The light generatedby the light source 124 is communicated to the keypad 104 and selectedcover parts of the cover 114. The light is shown in FIG. 2 as furthercommunicated to a light guide 126. One or more LEDs may be positionedappropriately under the keypad 104 and under opaque parts of the cover114.

FIG. 3 shows a flow chart of a method 200 to be performed by theprocessor 118. The method 200 may be implemented as a computer programto be run by the processor 118 in the mobile communication terminal 100.

The method 200 initiates in step 202, during which variables areinitialized and constants recorded. Subsequently the processor 118 isready for receiving real time acquired colour data 116 during step 204.The real time acquired colour data 116 are indexed in an array asdescribed above during step 206. The colours of the array are to begrouped according to a design criterion established by groupingparameters. The grouping parameters are either manually (step 208) orautomatically (step 210) selected. That is, the mobile communicationterminal 100 enables the user to select amongst a wide varieties ofdesign criterions, such as psychedelic, metallic or soft tone. Themobile communication terminal 100 further enables the user to downloaddesign criterions from the communication network.

The user of the mobile communication terminal 100 responds to theprocessor 118, whether the grouping parameters are to be manually orautomatically selected during step 212. The mobile communicationterminal 100 enables the user to pre-set responses to be given in step212, so that no user involvement is required during the method 200.

The indexed colours are grouped together in accordance with the groupingparameters during step 214 and, subsequently, a colour scheme isgenerated.

During step 218 the colours in the colour scheme are allocated to menusto be presented in the display 102, to parts of the cover 114, and/or tothe keypad 104.

In order to ensure, in particular, that the menus are visible to a userin the display 102, the colour scheme output, i.e. the menus overlayinga wallpaper in the display 102 and the colours of the keypad 104 andcover 114, is checked during step 220. If the colour scheme output isokay the method 200 terminates during step 222. If on the other hand thecolour scheme output is not okay, which is resolved during step 224, thegrouping parameters are adjusted during step 226 and fed back to thegrouping step 214.

FIG. 4 shows the display of a communication terminal according to oneembodiment. Section a) illustrates a view finder image of an object, inthis case a horse 402, which is captured by an image acquiring unit ofthe communication terminal. It is furthermore indicated a first 403 anda second 404 region comprising a first and second texture contentrespectively. The texture content are illustrated with a curved line 405and dots 406 respectively. Section b) illustrates a user interface inwhich symbols 410 and 411 arranged in a grid structure represent userinterface items available for selection by a selection frame 412. Theuser item 411 is here shown to be ready for selection, indicated by theframing of selection frame 412. Section c) illustrates a composite viewwhere the view finder image 401 is in the background of the gridstructure comprising the user interface symbols 410 and 411. In sectionc) it is furthermore illustrated how texture from the view finder imageis mapped and rendered onto the surface of a user interface item, inthis case the selection frame 412. The texture mapping is illustrated bythe curved line 415 in a first mapped region 413 and the dots 416 in asecond mapped region 414 originating from the corresponding view finderview 401 of a curved line 405 and dots 406 respectively. For printingquality reasons, the user interface elements or items are presented asplain encircled areas, although various of other alternatives arepossible. It is possible to render mapping of textures onto the surfaceof in principle any kind of object, two dimensional or threedimensional. The user interface elements may comprise menu items, scrollbars, dialogue prompts, frames etc.

For further understanding of the disclosed embodiments, a few additionalexamples will be given in the following.

EXAMPLE 1

A user executes a UI visualization mode, whereupon a view finder appearsas a background image on the display. User interface elements visible inthe present view of the display instantly changes appearance to reflectthe colours and texture of the view finder image. As the user points thecommunication terminal in various directions, the appearance of the UIelements changes continously to reflect the current image of the viewfinder. At any time, the user may, for instance by pressing a key of thecommunication terminal, select an appearance or visualization that he orshe likes.

EXAMPLE 2

A user wants to create a red appearance of the user interface. The userpoints the camera of the communication terminal towards a red brickstonebuilding and sees through the view finder an image of the building. Uponselection of a function, the user interface instantly changes to acolour tone which reflects that of the building quite nicely. Items ofthe user interface appear with variable red shades with shadows. Happywith the result, the user stores the scheme and also sends it attachedto a message to a friend.

EXAMPLE 3

A user is looking at a continously updated view finder of a presentationof a beautiful sunrise as captured with a camera of a communicationterminal. With software included in the communication terminal to giveadditional functionality and manipulating capabilities to the visuallyadaptive user interface, the user experiments to manipulate the visuallyadaptive user interface to render the user interface as invisible aspossible, but visible enough to make use of the user interface possible.Upon configuration of a few parameters, the user reaches an appearanceof the user interface that looks nice and wants to store that.

Hence, in other words, a camera of a communication terminal is used asan user interface theme search and capture lens. User interfaceelement(s) receive texture from objects appearing in a view finder view.The mapping of colours and/or texture can be done automatically or uponreceipt of user input in connection with selection of user selectablefunctions.

The UI visualization may change all the time, depending on what thecamera sees. It is also possible to save the visualizations and use themlater in any situation. One possibility is to make combinations of userinterface element visualizations generated in separate sessions. Thesetextures can be also be retrieved from other people who have made them.

1. A mobile communication terminal comprising a user interface, imageacquirer and a processor, wherein said mobile communication terminal isadapted to receive real time acquired colour data from said imageacquirer, said processor is adapted to generate a colour scheme for saiduser interface based on said real time acquired colour data, and whereinlight generating means are adapted to receive said colour scheme and toprovide a coloured light to said user interface in accordance with saidcolour scheme.
 2. A mobile communication terminal according to claim 1,wherein said real time acquired colour data comprises a colour patternor a photograph.
 3. A mobile communication terminal according to claim1, wherein said light generating means comprises a driver and a lightsource.
 4. A mobile communication terminal according to claim 3, whereinsaid light source comprises one or more multicoloured light diodes, aplurality of sections of multicoloured light diodes, or any combinationthereof.
 5. A mobile communication terminal according to claim 3,wherein said light source comprises a liquid crystal element.
 6. Amobile communication terminal according to claim 3, wherein said lightsource comprises a series of liquid crystal elements.
 7. A mobilecommunication terminal according to claim 3, wherein said light sourcecomprises a liquid crystal element and a series of liquid crystalelements.
 8. A mobile communication terminal according to claim 1,wherein said user interface comprises a display.
 9. A mobilecommunication terminal according to claim 7, wherein said user interfacefurther comprises a cover, a light guide, and a keypad.
 10. A mobilecommunication terminal according to claim 3, wherein said driver isadapted receive a control signal from said processor and to drive saiddisplay and said light source based on said control signal.
 11. A mobilecommunication terminal according to claim 1 further comprising a memoryand a table for storing said colour scheme.
 12. A mobile communicationterminal according to claim 1 wherein said image acquiring meanscomprises a camera adapted to generate a photograph to be utilised assaid real time acquired colour data.
 13. A mobile communication terminalaccording to claim 1, wherein said processor further is adapted toperform: (a) receiving said real time acquired colour data; (b) indexingof colours of pixels of said real time acquired colour data andgenerating an array of indexed colours; (c) selecting a groupingparameter; (d) grouping of said indexed colours in accordance with saidgrouping parameter; and (e) allocating grouped colours to said userinterface of said mobile communication terminal.
 14. A mobilecommunication terminal according to claim 1, wherein said user interfacecomprises user interface elements each having a surface onto whichtexture information can be mapped based on information from said colourscheme.
 15. A mobile communication terminal according to claim 14,wherein said mapping is configurable such as to reflect a customizedappearance of said texture.
 16. A method for generating a colour schemefor a mobile communication device comprising: (a) receiving real timeacquired colour data from a real time acquiring colour data generator;(b) indexing of colours of pixels of said real time acquired colour dataand generating an array of indexed colours; (c) selecting a groupingparameter; (d) grouping of said indexed colours in accordance with saidgrouping parameter; and (e) allocating grouped colours to a userinterface of said mobile communication terminal.
 17. A method accordingto claim 16, wherein said user interface comprises a display.
 18. Amethod according to claim 17, wherein said user interface furthercomprises a cover, a light guide, and a keypad.
 19. A method accordingto claim 16, wherein said real time acquired colour data comprises aview finder image data, user interface visual information, photograph, adrawing, or any combination thereof.
 20. A method according to claim 16,wherein said grouping parameter comprises one or more elementsestablishing design criterion for said colour scheme.
 21. A methodaccording to claim 16, wherein said grouping parameter is selected bythe user of said mobile communication terminal, is a default valuestored in said mobile communication terminal, or a combination thereof.22. A method according to claim 16 further comprises checking colourscheme output and feedback of an adjusted grouping parameter.
 23. Acomputer program product such as a computer-readable medium havingcomputer-executable components comprising instructions for receivingreal time acquired colour data from a real time acquiring colour datagenerator; (d) indexing of colours of pixels of said real time acquiredcolour data and generating an array of indexed colours; (e) selecting agrouping parameter; (f) grouping of said indexed colours in accordancewith said grouping parameter; and (g) allocating grouped colours to auser interface of said mobile communication terminal.